On the Measurement of Negotiation Dialogue Games
نویسندگان
چکیده
Nowadays, multiagent systems became a widely used technology in everyday life. More studies are needed to evaluate these systems from different aspects such as evaluating agent dialogues, the participants to these dialogues, and the protocols governing the dialogues, etc. In this paper, we define new measures for dialogue games from an external agent’s point of view. In particular, two measurement sets are proposed: in the first set, we use Shannon entropy to measure the certainty index of the dialogue. This involves i) using Shannon entropy to measure the agent’s certainty about each move during the dialogue; and ii) using Shannon entropy to measure the certainty of the agents about the whole dialogue with two different ways. The first way is by taking the average of the certainty index of all moves, and the second way is by determining all possible dialogues and applying the general formula of Shannon entropy. In the second set, we introduce two metrics: i) measuring the goodness of the agents in the real dialogue (i.e. the dialogue that effectively happened between the participants); and ii) measuring the farness of the agents from the right dialogue (i.e. the best dialogue that can be produced by two agents if they know the knowledge bases of each other). Many dialogue game types have been proposed in multiagent systems. In this paper, we focus on one specific type, namely quantitative negotiation such as bargaining.
منابع مشابه
Transfer of Bargaining Power Sources in Oil Trade Games
Bargaining Power is one of the important issues in oil trade negotiations. In this paper two effective factors in bargaining power i.e. patient time to deal and outside options of each player have been considered. The necessary relations for exchange of sources in negotiation have been derived.
متن کاملThe Complex Negotiation Dialogue Game
This position paper formalises an abstract model for complex negotiation dialogue. This model is to be used for the benchmark of optimisation algorithms ranging from Reinforcement Learning to Stochastic Games, through Transfer Learning, One-Shot Learning or others.
متن کاملEvaluating Persuasion Strategies and Deep Reinforcement Learning methods for Negotiation Dialogue agents
In this paper we present a comparative evaluation of various negotiation strategies within an online version of the game “Settlers of Catan”. The comparison is based on human subjects playing games against artificial game-playing agents (‘bots’) which implement different negotiation dialogue strategies, using a chat dialogue interface to negotiate trades. Our results suggest that a negotiation ...
متن کاملThe Effect of Interaction on Lexical Acquisition
This research showed that appropriate input and suitable contexts for interaction among students can lead to successful second language acquisition (SLA). This study based on Swain's (2005) notion of collaborative dialogue, aimed to study whether EFL learners participating in negotiation of meaning based tasks collaborate with each other and, if so, to investigate the role of this behavior in ...
متن کامل